| Results Homepage | API & CONOPS Document | Participation Agreement | FAQ | irex@nist.gov |
| Template Creation Time (s): 0.581 ± 0.007 |
| Search Time (s): 0.117 ± 0.008 |
| FNIR (@ FPIR=0.01): 0.0072 ± 0.0006 (± 90% confidence) |
| FNIR (@ FPIR=0.001): 0.0100 ± 0.0006 (± 90% confidence) |
| Miss Rate @ Rank 1: 0.0075 |
| Miss Rate @ Rank 10: 0.0058 |
| Miss Rate @ Rank 100: 0.0043 |
| Failure to Enroll (FTE) Rate: 0 |
| Dataset: | Operational Dataset 4th pull (stats on OPS4 images) |
| Samples used: | Both eyes |
| Enrolled Population: | 500K people |
| Enrollment Method: | Both (left and right) iris images per enrollment template |
| FNIR (@ FPIR=0.01): 0.0276 ± 0.0008 (± 90% confidence) |
| FNIR (@ FPIR=0.001): 0.0348 ± 0.0009 (± 90% confidence) |
| Miss Rate @ Rank 1: 0.0274 |
| Miss Rate @ Rank 10: 0.0225 |
| Miss Rate @ Rank 100: 0.0130 |
| Failure to Enroll (FTE) Rate: 0 |
| Dataset: | Operational Dataset 4th pull (stats on OPS4 images) |
| Samples used: | One eye |
| Enrolled Population: | 1M irides (500K people) |
| Enrollment Method: | One iris image per enrollment template |
Core accuracy for the identification task can be characterized by Detection-error trade-off (DET) plots. Generally, curves lower down in a DET plot correspond to more accurate matchers. The plots are interactive through the use of the Plotly.js graphing library.
Two-eye Accuracy
| Dataset: | Operational Dataset 4th pull (stats on OPS4 images) |
| Samples used: | Both eyes |
| Enrolled Population: | 500K people |
| Enrollment Method: | Both (left and right) iris images per enrollment template |
Single Eye Accuracy
| Dataset: | Operational Dataset 4th pull (stats on OPS4 images) |
| Samples used: | One eye |
| Enrolled Population: | 1M irides (500K people) |
| Enrollment Method: | One iris image per enrollment template |
Two-eye Accuracy
| Dataset: | Operational Dataset 4th pull (stats on OPS4 images) |
| Samples used: | Both eyes |
| Enrolled Population: | 500K people |
| Enrollment Method: | Both (left and right) iris images per enrollment template |
Single-eye Accuracy
| Dataset: | Operational Dataset 4th pull (stats on OPS4 images) |
| Samples used: | One eye |
| Enrolled Population: | 1M irides (500K people) |
| Enrollment Method: | One iris image per enrollment template |
Between 2010 and 2018, West Virginia University and the University of Notre Dame collected iris images of identical and mirror twins during the annual Twinsday Festival. The data collection procedure is described in Sabatier et al. Many twins participated in the data collection on multiple years. In all, \(5,078\) iris images from \(691\) twins were used to collect the results below.
The comparison scores were collected as follows: all available images were enrolled in a database; the same set of images were searched against the database, producing a total of \(5,078 \times 5,078 = 25.7\) million scores, including \(72,587\) twins scores, \(75,651\) cross-eye (i.e. left-vs-right irises from the same person) scores, and 25.5 million nonmated scores. The scores are not truly one-to-one if the submission performs enrollment-side score or template normalization.
NOTE: Some plots may not render well if the matcher produces highly discretized scores.
Histograms of Score Distributions
Cumulative Score Distributions
Accuracy is impacted by the size of the enrollment database (a.k.a the gallery size). Identification of the correct mate is expected to be more difficult for larger enrollment database sizes. The figure below plots FNIR (at FPIR=\(0.01\)) as a function of enrollment database size.
| Dataset: | Operational Dataset 4th pull (stats on OPS4 images) |
| Accuracy Metric: | FNIR (i.e., “miss rate”) at an FPIR of 0.01 |
| Samples used: | Both eyes |
| Enrollment Method: | One enrollment session per person |
Some apparant trends may be the result of random variation. Results for the 10K and 50K enrollment sizes were computed from 140K searches. Results for the 100K and 500K enrollment sizes were computed from 700K searches.
Inquiries and comments may be submitted to irex@nist.gov. Subscribe to the IREX mailing list to stay up-to-date on all IREX-related activities.